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00 : Abstract 



, We discuss an alternative to relative entropy as a measure of distance between mixed quantum 

QQ I states. The proposed quantity is an extension to the realm of quantum theory of the Jensen- 

m ■ 

Shannon divergence (JSD) between probability distributions. The JSD has several interesting 

oo : 

. properties. It arises in information theory and, unlike the Kullback-Leibler divergence, it is sym- 

I metric, always well defined and bounded. We show that the quantum JSD (QJSD) shares with 

p) • the relative entropy most of the physically relevant properties, in particular those required for a 

pH . "good" quantum distinguishability measure. We relate it to other known quantum distances and 

^ , we suggest possible applications in the field of the quantum information theory. 

, , , PACS numbers: 02.50.-r, 03.65.-w, 89.70.+C 

X 
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I. INTRODUCTION 



Distance measures play a central role in quantum theory, in particular in the context of 
quantum computation and quantum information. On one side they allow us to establish 
precisely the problem of quantum state discrimination [1]; on the other they are associated 
to the definition of the degree of entanglement, just to mention two very significant subjects 

a. 

Several distances between quantum states have been introduced. Many of them were 
defined as distances (divergences) between probability distributions and then extended as 
distances between quantum states. This is the case of the Hellinger distance, which, for two 
(discrete or continuous) probability distributions P{x) and Q{x) reads 

H{p,Q) = j2[v^)-vW)r (1) 

X 

and its quantum mechanical version is expressed as 

i^(plk) = Tr(v/p-v^)2 (2) 

where p and a are two density operators and Tr stands for the trace operator. Analogously 
the KuUback-Leibler divergence S{P, Q) = P{x) log{^|^} and the Kolmogorov distance, 
K{P,Q) = ^J2x l-^(^) "~ Qi^)\ extended to the realm of quantum mechanics. In the 
first case the resulting distance is known as the relative entropy ; in the second one 

the quantum counterpart is given by 

K{p\W) = ^Tr|p- (t|. 

Alternatives to these quantum distances have been recently proposed 

As we mentioned previously a basic issue in quantum information theory is to distinguish 
two quantum states by quantum measurement. In a seminal paper Wootters investigated 
this problem and introduced a "distinguishability distance" between two pure states [9|. He 
defines this distance as the number of distinguishable intermediate states between the two 
states. Braunstein and Caves extended this distance to density operators for mixed states 

n n 

and framed it in a general geometric formulation of quantum states space 
In a recent paper we revised the Wootters's distinguishability distance in terms of the 
Jensen- Shannon divergence (JSD) [12^]. The JSD between the probability distributions P{x) 



and Q{x) is defined by: 

P + O P + 

JS{P,Q) ^ S{P,^^) + S{Q,^^) 

= Hsi^^) - \hs{P) - \hs{Q) (3) 

where S{P,Q) is the Kullback-Leibler divergence and Hs{P) = — P(x) log Ffx) is the 
Shannon entropy. This quantity was introduced by C. Rao and J. Lin as a sym- 
metrized version of the Kullback-Leibler divergence and has been recently applied to the 
analysis of symbolic sequences as well as to other problems of interest in statistical physics 
jisl ]. It originates in information theory, it is always well defined and bounded and its 
square root is a true metric for the probability distributions space (i.e., its square root is 
symmetric, null only when the probability distributions coincide and it verifies the triangle 
inequality) . It has several interesting interpretations; for example in statistical inference 
theory it gives both the lower and upper bounds to Bayes' probability error In the 

framework of information theory the JSD can be related to mutual information [l5|. 

/^From some results of harmonic analysis it is possible to show that the metric space 
{X^, V JS), where denotes the discrete probability distributions space, can be isometri- 
cally mapped into a subset of a Hilbert space , [3 • This result establishes a connection 
between information theory and differential geometry, which, we think, could have interest- 



ing consequences in the realm of quantum information theory. 

In reference [l^, J. Lin proposed a generalization of Eq. Q as a distance for several 
probability distributions. In fact, let Pi{x), Pn{x) be a set of probability distributions 
and let tti, ...^t^n be a collection of non-negative numbers such that — 1- Then the 

JSD of the probability distributions Pi{x),i = 1...N is defined by 

N N 

JS<^--'-'-^\P,,...,P^) = HsiY.'^^P,) -Y.'^iHsiP.) ('^) 

1=1 1=1 

A remarkable feature of this generalized JSD is that it is possible to assign different weights 
to the distributions P^. This might be of importance in the study of quantum statistical 
inference problems |l9j |. 

In this work we extend the JSD into the context of quantum theory as a distance measure 
between mixed quantum states. We show that it shares with the relative entropy many of 
the most physically relevant properties. We also relate it to other commonly used distances 
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as well as we suggest its applicability as a good measure of entanglement and fidelity. We 
see that, when expression (jH) is extended to quantum theory, it can be interpreted as the 
upper bound for quantum accessible information. 

The structure of the paper is as follows. In the following section we review the basic 
properties of the relative entropy, mainly to guide us in our investigation of the proper- 
ties satisfied by the QJSD. In section III we introduce the QJSD and enumerate its basic 
properties. Finally we discuss possible applications of the QJSD in the field of quantum 
information theory. 

Notation remark: We will use the following notation: D{ , ) denotes a distance defined 
between probability distributions; -D( || ) denotes the corresponding distance between density 
operators. 



II. RELATIVE ENTROPY 



Let H be the Hilbert space associated to a quantum system and let S be the set of density 
operators describing the states of the system; i.e. S is the set of self-adjoint, positive and 
trace unity operators. 

The relative entropy of an operator p, with respect to an operator a, both belonging to 
iS, is given by 

5(pl|a) = Tr[p(logp-loga)] (5) 

where log stands for logarithm in base two. S'(p||cr) is nonnegative and vanishes if and only if 
p = a. It is nonsymmetric and unbounded. In particular, the relative entropy is well defined 
only when the support of a is equal to or larger than that of p. Otherwise, it is defined to 
be +00 0]; (the support of an operator is the subspace spanned by the eigenvectors of the 
operator with non-zero eigenvalues). This is a very restrictive requirement which is violated 
in some physically relevant situations, for example when o" is a pure reference state j^. 

Now we list the fundamental properties of the relative entropy. For the proofs and a 
detailed discussion see references and Q: 

1. is invariant under unitary transformations, that is 

S{UpUmUaU^) = S{p\\a) (6) 
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for any unitary operator U. This is a quite natural property to be satisfied by a 
distance, because a unitary transformation represents a rotation in the Hilbert space 
and the distance between two states should be invariant under a rotation of the states. 

2. "Generalized if-theorem" . For any complete positive, trace preserving map $ given 

by 

i i 

S{^p\\^a) < Sip\\a) (8) 

This is a very significant result because the most general way that an open quantum 
system evolves is mathematically represented by a map of the type given by Eq. (|7j). 
Technically, this kind of map is known as a CP — map. Therefore the meaning of 
Eq. (jHl) is that non-unitary evolution decreases distinguishability between states. Of 
course, an unitary evolution is a particular case of a CP — map. 

Another example of a CP — map is given by ^ • PiCrPi with Pi being a complete set 
of orthogonal projectors (P/ = Pi and = Pi). Therefore, 

S{npP,\\naPi) < S{p\\ct) (9) 

3. S is jointly convex: 

SiY^X.P^'^WY.XM'^) < 5^A,5(p«l|a») (10) 

i i i 

where the Aj are positive real numbers such that Aj = 1. 

4. Let p^^ and a^^ be two density matrices of a composite system AB (represented by 
the Hilbert space Ha ^Hb)- Then 

^(/Ik^) < Sip^^'Wa^'') 

S{p''\W'') < 5(p^^||a^^) (11) 

with p"^ = TtbP^^ and p^ = TtaP^^ (here Tta and Ttb represent the partial trace 
operators). These inequalities have a very natural interpretation: to take the trace 
over a part of a system leads to a loss of information and therefore it becomes more 
difficult to distinguish between two states of the composite system. 
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5. S is additive in the sense that 

'5'(pi ® P2|ki ® o'2) = '5'(pi||o-i) + 'S'(p2|k2) (12) 
with pi,aieSA and p2, (72^83- 



6. The relative entropy verifies Donald's identity [21|: Let us suppose that the density 
operators pi occur with probability pj, yielding an average state p = YliiPiPi let a 
be an arbitrary density operator. Then 

Y,P^S{p^h) = J2pMpM + S{p\\cr) (13) 

i i 

III. AN ALTERNATIVE TO THE RELATIVE ENTROPY 

We define the quantum Jensen-Shannon divergence (QJSD) as 

JS{p\\a) = llSipW^) + ^(^11^)] (14) 
which can be rewritten in terms of the von Neumann entropy, Hj\f{p) = — Tr(plogp), as 

JS{p\\a) = H^{^) - - \h^{^) (15) 

If p and 0" are density operators with complete sets of eigenvectors and such 

that p = '^iri\ri){ri\ and a = J2j then the QJSD between p and a is expressed 

as 

JS{p\\a) = i{$^|(4|r.)|V,log(^) + 5^|(4|.,)p.,log(^)} (16) 

with Afc = J2i (^fcki) ^j\{'^k\sj)\'^ and {I^a:)} a complete set of normalized eigenvectors 

of p + cr. 

This quantity is positive, null if and only if p = a, symmetric and always well defined. 
In fact, the restriction imposed on the supports of p and a for the relative entropy is lifted 
for the QJSD. 

If p and a commute they are diagonal in the same basis, that is, 

P = '^r,\i){i\ a = '^Si\i){i\ (17) 

i i 

with \i) an ortho normal basis. Then 

JSip\\a) = JSi{r,},{s,}) (18) 
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The QJSD is bounded. In fact, as it is known, the von Neumann entropy satisfies the 
following inequality if p = J^iPiPi a mixture of quantum states pi with pi a set of 
positive real numbers such that J2iPi = then 

HNi^Pipi) < ^PiHN{pi) + Hs{{pi}) 

i i 

The equality is attained if and only if the states pi have support on orthogonal subspaces. 
By putting Pi = P2 = \ and pi = p and p2 = c" in the inequality above we have 

< JS{p\\a) < 1 (19) 

Properties 1 to 4 of relative entropy are inherited by the QJSD and their validity can be 
checked directly from the representation (fT^ . For example, property 2 for the QJSD can 
be proved as follows: 

J,S($p||$or) = ) + S{^a\\^ )] 

< l[S{p\\^) + Sia\\^)] = JSipWa) (20) 

Additivity does not remain valid for the QJSD. However, the QJSD verifies a "restricted 
additivity" : 

JS{pi (g) p2\\ai (g) P2) = JS{pi\\ai) (21) 

with pi,aieSA and P2^Sb- This is an important point that deserves some attention. We 
claim that ()2H) is enough to prove property 4 for the QJSD. To prove this, we follow the 
same steps as Nielsen and Chuang in their book where the relative entropy is studied Q]. It 
can be shown that there are unitary transformations Uj on the space corresponding to the 
part B and numbers Aj, (Yl,- Xj = 1) such that 

for all density operator p^^ of the composite system AB. Here d is the dimension of the 
Hilbert space of part B and / its identity operator. Hence, from convexity, the invariance 
under unitary evolution and the restricted additivity verified by the QJSD, we have: 



< Y.X,JS{U,p^^U]\\U,a^^U]) 

j 

< ^A,J5(p^^||a^^) = J5(p^^||a^^) (22) 

j 

Of course, due to the linearity of the partial trace operator, this property can be derived 
from the analogous ones satisfied by the relative entropy. 

The non-increasing character of the QJSD upon a CP — map has the following conse- 
quence: Let {Ea} be a set of positive - operator - valued measure (POVM), that is, a set 
of Her^itian ope.ato. > that =at.fy E. - L It i= known that ev„y gene.ah.ed 
quantum measurement can be described by a POVM m|. Given two operators p and a 
belonging to S, we can introduce the probability distributions 

Following Vedral [2^ we define 

JSi{p\\a) = sup JS{{pa},{qa}) 

where the supremum is taken over all POVM's. Given that S{p\\a) > Si{p\\a) with 
S'i(p||a") = supj^^i S{{pa}, {la}), we can derive the inequality 

JS{p\\a)>JS^i{p^},{q^}) (23) 

Of course the map p —>■ Tr{pEa) is a CP — map. 

To conclude the listing of properties satisfied by the QJSD we note that starting from 
Donald's identity, we can obtain a useful representation for the QJSD: 

2JSip\\a) = Sip\\r) + 5(a||r) - 25(^||r) (24) 

where r is an arbitrary density operator. This identity allows us to evaluate the QJSD 
between two density operators in terms of a third arbitrary one. 

In the following discussion we investigate the relation between the QJSD and other quan- 



tum distances. In reference 12| we showed that the JSD is a good approximation to the 
Wootters distance (up to third order in their power expansion). To search for a similar re- 
lationship between the QJSD distance and that introduced by Braunstein and Caves, let us 
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consider two neighboring density operators, p and p + dp. The Q JSD between them reduces 
to (up to second order in e) 



JS{p\\p + dp) 



X] — + ^{Pj -Pfc)(logPj - \ogpk)\akj\ 



(25) 



where we have assumed that dp = eu, with e ^ 1. The ujk are the matrix elements of u 
in the basis that diagonahzes p, that is p = J2jPj\j){j\^ eigenvectors of p + dp are 

written (up to first order in e) in the form: 

k 

By expanding logp,- — logpfc = — _)_ gj^^ after some algebra, the expression 

can be rewritten as 



JSip\\p + dp) = - 



(26) 



with '(9 a term that involves sums of powers of {pj — pk) of even order not lower than four. 
The two first terms coincide with the metric introduced by Braunstein and Caves as a 

1 



JS{p\\p + dp) ^ -ds 



DO 



As these authors further note, the metric dsno is related to the Bures' metric, B{p\\a) 
v/2[(l-Tr(pi/2^pi/2)i/2]i/2. 

4B\p\\p + dp))^dslo 



Therefore, we can conclude that for two neighboring states 



Bip\\p + dp)^^2JSip\\p + dp) 



(27) 



To finish this section, we proceed to evaluate the QJSD in a particular case. Let us 
consider the density _ operator pw corresponding to a Werner state, for a system of two 
1/2-spin particles 



221: 



pw = + 



1 -F 



|^+)(^+| + |$+)($+| + |$-)($-|) 
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with |^^) = ;72 (I Ti) ± I it)) and |$^)=^(| TT) ± I ii))- ^ is the purity of the state pw 
with respect to the reference state a = |^^)(^^|. Then, in terms of the purity F, the QJSD 
between pw and a, results: 

JS{pw\W) = i[FlogF - (1 + F) log(^)] (28) 

The fact that we can evaluate the JS{p\\a) when one of its arguments is a pure state, is a 
clear advantage of the QJSD over the relative entropy, which becomes divergent in this case. 

IV. DISCUSSION 

In this section we suggest possible applications of the QJSD in the context of quantum 
information theory. Here we show that the proposed distance is useful to generate an entan- 
glement measure, as well as an alternative concept of fidelity. We also give an interesting 
interpretation of QJSD as the upper bound for the accessible quantum information. A more 
detailed study of each one of these proposals will be presented in a future work. 

A. Entanglement 

Let H = 'Ha®'^b be the Hilbert space of a quantum system consisting of two subsystems 
A and B. According to Vedral et. al. any measure of entanglement £ has to satisfy the 
following (necessary) conditions |^: 

• i) £{p) =0 if f p is separable. Let us recall that a state is separable if it can be 
expressed as p = XjPi^ (S> P2'' for some density operators Pi^Sjs, and p2^eSB, and 
E,A, = 1, A, >0. 

• ii) £{p) = £{Ua ® UbpU\ ® f/jj) for two arbitrary unitary operators Ua and Ub acting 
on the corresponding Hilbert space. 

• iii) £{p) is convex with respect to its argument: 

i 3 
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• iv) £{p) decreases under generic quantum operations, that is, if {Vi} are bounded 
operators such that ^ ViV^ = 1, pj = -^^-^ and \j = TiiVjpV^), then 

£{p)>Y.^,£{p,) 

3 

Vedral and collaborators [3] showed that an entanglement measure defined as 

£{p)=iniD{p\\a) (29) 

satisfies conditions i)-iv), whenever the distance D : S ® S ^ "R, verifies the properties a)-b) 
listed below: 

• a) D{p\\a) > and D{p\\p) = for any p,aeS 

• b) £)($p||$cr) < D{p\\(7) for any CP - map, $. 

In fl29|l the infimum is taken over the set of separable states. 

As we showed in the preceding section, the QJSD JS{p\\a) satisfies these two require- 
ments. So we can introduce a new entanglement measure by 

Sjs{p) = miJS{p\\a) (30) 

where, once again, the infimum is taken over all separable states. 

B. Fidelity 

The fidelity of states p and a is defined as j3|'Ql 

F{p\\a) = (rr^^a^^ (31) 

This quantity is symmetric, invariant under unitary transformations and bounded between 
and 1. For a pure state a = |\E')(\E'|, fidelity reduces to the amplitude (^Ipl^'). 
The fidelity is related to the Bures's metric by the expression 

B'{p\\a) = 2 (l - v^n^) (32) 

Taking Eq. ()27|) into consideration we can introduce an alternative definition of fidelity ()3H) : 

Fjs{p\\a)^{l-JS{p\\a)f (33) 
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^From inequalities (fT^. Fjs must be bounded between and 1. In particular, for p = 
a, Fjs = 1 and FjsipWcr) = if and only if p and a have support on orthogonal subspaces. 

The proposal (jH!^ has another justification. As a textbook exercise it can be shown that 
the fidelity of states p and a can be evaluated in terms of purifications of these states as 

Fip\\a)=maMM' (34) 

M 

where is any fixed purification of p, and the maximization is over all the purifications of 
(T 111. At this point, it should be recalled that the Wootters' distance between the two pure 

n 

states lip) and is given by j9[: 

II Iv^)) = arccos |(^|(/?)| 
Then, fidelity can be expressed in terms of the Wootters' distance as 

F{p\\a) = inaxcos2(W(|V')|||v^))) 

M 

= max(l-iy2(|^)|||^))) + ...) (35) 

M 

Now taking into account the relation between the Wootters's distance and the JSD diver- 



gence 
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wmM)^V2Jsm\m 

we can approximate 



F{p\\a)^me.x{l-JS{\m^))Y (36) 

which, we think, might be taken as an interesting starting point to investigate ()33j] as a 
fidelity measure. 

C. Quantum information accessibility 



Holevo [25[ proved that, if a system is prepared in a state X chosen from one of the density 
operators pi, {i = 1, ...,n) with probability Pi, then the (mutual) information /(X : Y) that 
can be gathered about the identity of the state X by a POVM measurement, with outcome 
Y, is bounded according to the inequality 
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The quantity x is precisely the extension of expression Q to density operators with the 
weights TTj replaced by the probabilities jOj, that is, x = JS^^^''"^"-\pi\\.--\\pn)- This fact 
provides an interesting interpretation of the generalized QJSD. 
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